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ABSTRACT 

A study investigated the effectiveness of training 
students in think~aloud procedure to improve reading comprehension. 
Subjects were two groups of Taiwanese university students of English 
as a Foreign Language (EFL). In the first week, a think-aloud 
training session was given to one group. Then both groups were asked 
to read an English passage and take a comprehension test. In the 
second week, the second group was given initial think-aloud training 
and the first group was given additional training. Both groups read a 
new passage and took a comprehension test. Finally, both groups were 
administered a questionnaire about use of the think-aloud protocol. 
Results showed no significant difference between the groups but did 
show significant differences in the mean scores of the first and 
second tests. Possible explanations are considered. Questionnaire 
responses revealed factors that could affect student comfort level 
with the think-aloud procedures (length of training, text 
difficulty). It is concluded that while these results are not 
conclusive, the procedure can be used as a means of fostering text 
awareness and comprehension. Contains 32 references and the survey 
instrument. (MSE) 
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Abstract 

Tliis paper repons the implementation results of ushig think-aloud procedure to 
improve L2 students' reading comprehension. The study involved two groups of unKersiry 
EFL students m Taiwan. The first week, a think-aloud training session was given to one 
group of students. After the training, both groups were asked to read an English passage 
and take a comprehension test. Tlie second week, the other group was also given think- 
aloud training. Again, both groups read a new passage and took a couiprehensiou test. 

i* 

Finally, both groups responded to a questionnaire to give comments on the use of the 
think-aloud procedure. Statistical analyses were performed oji the first and second test 
scores of both groups. Responses to the questiotmaire were also analyzed. 

No significant difference between the two groups was found but significant 
differences between the mean scores of the first and second reading comprehension tests 
were found. Tlie responses to the questionnaire were in congruence with the quaniitatfve 
data. In conclusion, although certain considerations are needed while implementing the 
procedure, the think-aloud procediue has improved the reading comprehension of both 
groups and seems to be a \dable approach to enhance the reading comprehension of 



Taiwanese EFL students. 
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The Use of Think- Aloud Procedure for EFL Instruction 
UnKcrsiw students in Taiwan usually face heavy reading loads in English because 
of the use of textbooks wTitten in English. However, problems arise when students face 
demanding reading tasks but without effective strategies to resort to. Frustrated by their 
incapability to cope with the situation, many students find themselves on the verge of 
giving up reading au\thing in English (Cheni, 1993). Improving students English reading 
ability, thus has been set as the primaiy objectwe of most Freshman English Programs hi 
Taiwan (Lu, 1976; Tsai, 1979; Tse; 1985). To ease students English reading anxiety and 
improve students^ reading proficiency, English as a Foreign Language (EFL) educators in 
Taiwan are searching for new approaches to use in their classrooms (Cheni, 1993; Chem 
& Clii^ 1989; Yang, 1985). As a Freshman English teacher, the researcher has introduced 
the think-aloiid procedure to the students with an attempt to facilitate their reading 
comprehension. This paper reports the implementation results of the procedure. 

Developed by Newell and Simon (1972), think-aloud procedure was first used as a 
research tool to study cognitive problem-solving activities in ex-perimeutal psychology. It 
has also been used m descriptive research on writing processes (AUleibach, Bass, Hoo, 
Siniih, Weiss, & Williams, 1988; Elayes & Flower, 1980, 1983), readhig processes, and 

reading strategies (Fehrenbach, 1991; Olsen, Dafi>, & Mack, 1984). Wliile controversy 

¥ 

existed as to whether the think-aloud procedure was an appropriate method to study the 
covert mental activities involved in leaniiiig (AfDevbach & Johnston, 1984), think-alouds 
have moved fiom the realm of data collection into instruction (Beriter &. Bird, 1985; 
Fawcett, 1993). Tliink-aloud is being used as an instructional tool for teacliing problem- 
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sohing strategies (Hayes, 1981), composition (Seardaraalia, Bereiter, Sc Sieinbach, 1984), 
and reading (Palinscar & Brown, 1984). 

Because of the increasing use of think-alouds in classrooms, the effectiveness of 
such au approach as a means to enhance reading comprehension in first language (LI) has 
garnered reading researchers^ attention in recent years. Tliurmond (1986) used think- 
alouds to teacli verbal reasoning and vocabulary^ skills to 22 eleventh-grade mmoidty high 
school students and found significant pretest-posrtest differences on the Scholastic 
Aptitude Test and the Nelson-Denny Reading Test. Bereiter and Bird (1985) conducted 
an experimental study iiwolving eighty students in Grades 7 and 8 and found significant 
adx aiitages for target strategy acquisition and reading comprehension using a treatment 
combining thiuk-aloiid strategy, modeling, and practices. Baumann, Seifeit-Kessell, and 
Jones ( 1992) extended the work of Bereiter and Bird (1985) to investigate the 
effectiveness of explicit think-aloud iustniction on elementary' students^ comprehension 
monitoring abilities and found positive results. Ward and Traweek (1993) conducted two 
empirical snidies to evaluate the effect of using the tliink-aloud technique for elementary 
students during a reading asscssineut. The first study showed that asking students to gi\'e 
reasons for responses unproved performance on a test of reading comprehension. The 
second study show'ed that incoqmrating the think-aloud technique in remedial reading 
Lnstniction resulted in substantial gains in reading comprehension. 

Tire aforementioned studies seems to suggest the positive effects of think-alouds 
on reading comprehension. However, the^^e studies were conducted in LI reading 
settings. Wliether the procedure can facilitate reading in an EFL context or not is still a 
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topic which awaits exploration. Up to now, only a limited number of studies have 
pro\ided such information indirectly. For example, Block (1986) used ihink-alouds to 
examine the comprehension strategies used by college-level English as a Second Language 
(ESL) students. In the study, several participants reported that thiuk-alouds were an 
impoitant leaniing tool and they learned to read better because of the use of it, Davis and 
Bistodeaui 0993) study has also provided some incidental empirical evidence on the elTcct 
of the procedure. They used data collected from think-aloud protocols to detennme how 
two groups ofaduh subjects approached reading in their LI and L2, Besides finding 
evidence to suppon the contention that components of the foreign language itself have a 
poweifai impact upon psychological processing during L2, they also found that their 
subjects had enjoyed performing the tliiuk-aloud protocols and felt their L2 reading had 
improved as a result of participation in the session. Cliem (1993) explored the significant 
role verbal report played in L2 reading comprehension for different proficiency levels of 
EFL students. It was found that think-alouds facilitated lower EFL proficiency readers’ 
comprehension. 

Although positive findings are available in the literature, the small number of 
studies and lack of direct investigation on the ejQTectiveness of think-alouds for L2 reading 
have made the drawing of conclusions and instructional implications dLQBcult. To add to 
the literature and give further insights into this issue, an empuical study was conducted. 
Specifically, tliree research questions were posed in the study: (a) Do the reading 
comprehension scores of a group of EFL students, who have been instructed with the 
thiiik-aloud procedure, differ significantly from those of the other group who did not 
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rcccK'e the iastaiction? (b) Does the length of tliiiik-aloud instruction aflfect 
students^ Improvement of reading comprehension? (c) Wliat are the possible difficulties 
EFL students may encounter while using think alouds? 

Method 

Subjects 

Fifty-sc\ en Chinese students enrolled in two Fresluiiaii English classes in a 
university in Taiwan were invok ed in the study. Tliere were thiay-one students in one 
class and rwenty'-sLx students in the other class. Both groups of students were identified 
by the uui\ ersity English placement test as high English proficiency level students. The 
placement test has been used by the imiversity to assign students to different levels of 
English classes. Students are classified as high, raid, or low based on their biowledge of 
grammatical structures and listening and reading coinprehciisioii abilities. Tlie mean score 
for Group One students was 73.2 and the standard deviation was .62. Group Two 
students mean score was 73.6 with a standard deviation of .63. For the two groups of 
students University E!iiglish Placement Test scores by language skills, please see Table 1. 
Tliere was no significant difference between the tw^o groups' reaaitig comprehension 
scores on the University Euglish Placement Test. 

Insert Table 1 about here 



Tlic students were from various departments in the College of Management and 
Social Sciences. None of the subjects in either group had been exposed to the tliiuk-aloud 
procedure before the study. Tlie study was conducted in the middle of the semester to 
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allow students to familiarize tlieinseK'es with the new uiiiversit\' en\'iroiimeiit and the 
logistics of the course. 

Instrumentation 

Two tests which consisted offi\e multiple-choice and five short-answer questions 
were used to measure the students' comprehension of the two passages. Two expeiicnced 
Frcslunau English teachers were consulted regarding the appropriateness of the tests. A 
questionnaire was also developed to obtain information on the students ttitudes toward 
the use of the think-aloud procedure (see Appendix). 

Materials 

Two passages, labeled passage A and passage B, were selected from the high level 
Freshman English textbook, Mosaic /( Wegmann & Kiiezevic, 1990). The two passages 
were of similar length and readability le\’el according to the Bormiith Grade Level. Roth 
passages addressed health issues and neither of them was related to the students'' major 
fields of study. 

Prpc_eiluie 

Tlie traming of tliiiik-aloud procedure, testing of reading comprehension, and 

I 

collecting of test results and qualitative data occurred within a two-week period. Each 
class period lasted for one hour. In the first week. Group One students were introduced 
to the think-aloud procedure before reading passage A. A training session based on the 
Baniiiaim and Schmitt Hxqdicit Insmiction Model (1986) was adopted to familiarize 
subjects with the thiiik-aloud procedure. The training included: 1) an explicit explanation 
of the purpose of think-aloud procedure, 2) listening to a prerecorded demonstration tape, 
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3) teacher modeling of the use of the procedure, 4) guided practices with a short passage, 

and 5) independent practices. After the training session. Group One students were given 

ten to twenty niinutes to read aloud m class every day for the rest of the first week. I'o 

encourage students to verbalize their exact thoughts, the researcher advised the students 

to feel free to use either LI (i.e., Chinese) or English to tliiiik aloud. At the end of the 

first week, Grouj) One students were asked to rend passage A and take a comprehension 

test. Group Two students, although not receiving the think-aloiid training, were also 

asked to read passage A and take the same comprehension test. 

The second week, Group Two students were given the same kind of think-aloud 

Iraiiiing ajid practice that Group One had received earlier. Meanwhile, Gioup One 

students continued to use the think-aloud procedure for independent reading during the 

second week. At the end of the week, both groups were given passage B and a 

corresponding coinprehension test. Afterwards a questionnaire was given to both groups 

to elicit responses tow ard the lliiiik-aloud training and the use of think-aloud procedure. 

To avoid being constrained by their limited English language proficiency, the students 

w ere allowed to use both Chinese and English to aiisw'er the questionnaire. Tlie 

/ 

questionnaire was ajiswcred before the students were given their reading comprehension 

scores of passage A and passage B so that they would not be affected by the test results. 

«< 

In summarv', the data collected for this study consisted of I) reading 
comprehension test scores of passage A for both groups, 2) reading comprehension lest 
scores of passage B for both groups, ai.J 3) responses from the questionnaire. Tlie 
statistical analyses included: 1) an analysis of covariance on the comprehension scores of 
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passage A For both groups iu which the reading comprehension on the Unwersity English 
Placement Test was panialed out to make sure that any significant difference was not due 
to initial diflferences between the groups in comprehension ability, 2) a Mest of Group 
One mean scores of passage A and passage B, 3) a t-test of Group Two mean scores of 
passage A and passage B. Tlie analyses of the questionnaire responses focused on the 
paiticipiUits^ attitude toward the thiiik-aloud procedure, the advanlagcs and disad\antages 
of using tlihik-alouds to enhance EFL reading comprehension, and the appropriateness of 
the training session, Students^ comments were sorted and categorized. 

Finduigs 

Comprehension test results 

Table 1 presents the reading comprehension test results of Group One and Group 
Two on passage A and passage B. Group Ones reading comprehension score for passage 
A was 7.68 and the score for passage B was 8.65. There was a ,97 increase of the test 
score. Group Twos score for the first reading comprehension test was 7,50 and the 
score for passage B was 8.92. lliere was a 1.42 increase of the test score. Tlie t-test 
revealed that both of the increases w'ere statistically sig'iificant (p<.0l). 

/ 

[nseit Table 2 about here 



Tliis result demonstrated tl^at for Group One students, after the thiiik-aloud 
traiui g and one week of practice of the procedure, their reading comprehension score 
significantly improved. As for Group Two students, the reading comprehension score also 
improved significantly after the think-aloud training. In other words, one week and two 
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weeks of think-aloud training both made a siguificaui improvement on the subjects’ 
reading comprehension scores. 

Statistical significance was not found between Group One and Group Two's 
comprehension scores of passage A. This means that although after receiving the think- 
aloud training. Group Ones comprehension score on passage A was slightly liighcr than 
Group Two's. Tlie diiTerence, however was not significant. 

Responses to the questionnaire 

In general both groups of students responded positively to the use of think-aloud 
procedure, Foity-four (77%) students believed that the use of the procedure had 
improved their Fiiglish reading comprehension ability. Tliree (5%) responded that the use 
of the procedure both helped and liindcred the compreheusioii. Four (7%) replied that the 
procedure neither helped nor hindered the comprehension. Six (1 1%) students claimed 
that the use of the procedure interfered with their understanding of the texts. Students 
responded positively because the method eiicouiaged them to make prediction and helped 
them to focus on meaning of the te.xt rather than individual words, llie following 
responses are examples of typical reasons for the positive effect: 

'Tt lets me think about the meaning of the words and can guess the meaning of the 
whole sentence.’^ 

It can make me think more about the meaning.’’ 

“ I can guess the meaning of new words without looking them up in tlie 
dictionary and this saves me a loc of time.’' 

^ It encourages me to think and make guesses about the meaning of the texts.*' 
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Oil the other hand, negative responses were due to unfamilianty of the procedure 
and the interference with regular reading habits. Some students thought it was time- 
consuming to use the procedure to read. The following responses exemplified the 
negath'C comrneuts: 

''It sonicthnes hinders my reading comprehension because I like to read by 
thinking without talking out. " 

“Tliinking out loud is distracting. I can not concentrate when I was thinking 
aloud. ' 

"li takes a lot longer to rend, 

Tie three students who stated that the procedure both hindered and helped the 
comprehension ftirdier explained that the procedure helped diem to understand the 
unknown text based on what they had known but it intemipted their train of thought when 
there were too many unknown words in one sentence. To stop and think out loud the 
nieaiiiiig of the words before mo\iug on to the next sentence was fixistratiiig. 

Fifty-four (95To) students responded that the procedure made them more aware of 
their own reading behavior. Three (5%) students stated that because of the short duration 
of the practice, they had not felt the effect of the procedure. As for the anioiuit of time 

giveu to practice the think-aloud procedure, Foity'-five (79°/o) students responded that the 

¥ 

think-aloud training and practices were too short. Twelve (21%) students thought that 
they had enough exposure before taking the quizzes. Among the students who thought 
that the practice time was not ecougli, there w^ere approximately equal number of students 
in either group. Twenty- three students in Group One, vsiio had the two- week practice. 
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thought the time was too short; whereas twenty-t?^vo students in Group Two, who had 
only one week of training, thought the training was too short. One more week of practice 
did not seem to make a difference. 

When asked if the use of the procedure had helped them to get higher scores in the 
comprehension tests, tweiiry-niue (51%) students beUeved that it had, twenty (35%) 
students responded that they did not know, and eight (l4®o) students said that they did not 
tliiuk that the procedure had affected their scores. The students who responded positively 
answered that they used the tliink-aloud to guess the correct answer wdiile tackling a 
difficult question. Students who did not know if the procedure had helped them get a 
better grade evplained that they wouldnt know before they received the test results. 
Students who thought that thiiik-alouds did not help complained that the exposure to the 
procedure was not enough to make a difference. A few students commented that the time 
given for taking the comprehension tests was too short to use tliii’k-alouds. 

Fifty-two (91%) of the students answ^ered that they considered the procedure a 
viable tool to help them improve the comprehension of English texts and would continue 
to use the procedure to read Eughsh after the study. Three (5%) remain skeptical and 
were not sure whether they would use it again or not. Two (4%) answered that they were 
not comfortable with the use of the procedure and would not consider using it in the 
hiture. 

Conclusions, Discussions, and Limitations of the Study 

Based on the results, several corclusioiis can be drawn. Fust, both groups of 
students reading comprehension scores improved significantly after receiving one and 
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rvso-weeks of tliink-aloud training. Student^ perception of the tliiuk-aloud procedure, 
wliich was obtained from the quesiiomiaLre, was consistent with the comprehension test 
results. Tlie majority of the students who participated in the study felt that the procedure 
has helped them to better comprehend the English passages and considered the think- 
aloud procedure an elSective means to enhance their English reading ability. This positive 
finding coiToborates the direct evidence provided by LI think-aloud studies (Baumann, 
Seifcit-Kessell, & Jones, 1992; Bereiter & Bird, 1985; Casanave, 1988; Nist & Kirby, 
1986; Ward & Traweek, 1993) and indirect evidence by L2 studies (Block, 1986; Chem, 
1993; Davis & Distodeau, 1993). However, the insignificant difiference betw'ecii the test 
scores of the two groups is somewhat discomforting because it means that there was no 
direct link between the one-w^eek training of the tliink-aloud procedure and 
comprehension improvement, even though this seems to be demonstrated by the 
improvement of Group Two. Several possible factors might have contributed to tliis 
coiiflising result. A possible explanation for it could be learner differences. Similar to 
what Block ( 1986) and Ward and Traweek ( 1993) have reported, some students found 
tliink-aloud dismptive of the reading continuity. In addition, students verbal ability miglit 
have interfered with their effective use of tlic procedure. For students who are less verbal, 
the procedure can impose extra psychological demand on them, hi the study, among the 
six students who responded negatively to the procedure, four of them were in Group One. 
This difference could have caused the insignificance between the two 
group. ^ comprehension score of passage A. After one week of using think- alouds. Group 
Two students outperformed Group One in the comprehension score of passage B. 



14 



EFL Think- Aloud 14 



Although speculaih e, it could be an indication that Group Two students responded better 

than Group One students to the think-aloud tasks. 

Second, because of the use of the procedure the participants have become more 

aware of theii own reading beba\'ior. As Block ( 1986) points out, the task of thinking 

aloud forces L2 readers itttontioii on what tliey understand and what they need to know. 

By attempting to articulate what they understood, the participants of tliis study became 

aware of what tliey did not understand. Such awareness helped them to see the need to 

coordinate strategic processes, such as oiaking predictions, s^aTcliing background 

knowledge, and seeking clarification (Ward &. Traweek, 1993), Tliis awareness of one 

own reading behavior and the use of comprehension strategies hold an important 

ramification for L2 readers, Tlie participants of this study were not no\ ice readers. Tiey 

were unh ersity suidents who had acquired certain reading comprehension strategies that 

proficient readers have in their LI reading. However, as L2 readers, they needed to be 

prompted to regulate their performance. Tlie tliiuk-aloud condition, which required them 

to verbalize their tliiiiking, might have brought out those internalized comprehension 

monitoring strategies to the conscious level, and thus facihtated the application of iea<liiig 
/ 

skills that were available but not used spontaneously in L2 reading. McLaughlin (1990) 

argues that all learning requires a certain degree of awareness and there is no exception in 

¥ 

L2 leaniing. Think-aloud requirement activates the metacogiiitu e monitoring for self- 
regulation that has not become automatized in EFL students. In otlier words, explicit 
awareness and overt verbalizations ofthiuki**g process have not only caused deeper 
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processing of the text but also facilitated the transfer of the existing comprehension 
strategies from LI to L2. 

Third, the responses to the questionnaire have revealed factors that could affect 

students' comfort level with the use of tliiok-aloud procedure. The duration of the traming 

was one of them Neither one nor two-week traming wms enough to familiarize students 

with the procedure. Despite the positive effect, many students still felt uucoinfoiiable 

using think-alouds after oue-week or tw'o-week of ex'posure. In addition to the training 

time, the difficulty level of the text could have been a confounding factor. Research has 

shown that tasks requiring students to verbalize their thinking promote more deliberate 

plaiming (Ericsson & Simon, 1984). Wlien subjects are simply instnicted to verbalize the 

information they attend to, the structure of the reading process is not changed. When the 

tasks require the reader to explain the reasons for meauiug making from texts, the process 

moves from a perceptual one to a cognitive one. Verbalized description, thus is helpful 

with more difficult items that requii'e some search for alternative solutions (Ward & 

Traweek, 1993). Nevertheless, the subjects in this study pointed out that when the text 

was too difficult, the procedure did not help but fiirther fi-ustrated them by requiiing them 

/ 

to attend to an additional task, i.e., verbaLiziiig thoughts. It seems that there might be a 
threshold of text difficulty level to reap the flill benefits of the tlunk-aloud procedure. 
Additional research is needed hi determining the proximity of the text difficulty for 
ultimate effectweuess of think-aloud use. 

The major complaint the students had regarding the difficulties in using think 
alouds was the impairment of the reading speed. The result was in congruence with 
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Breeder and Birds (1985) study repoit. How’over, if the students had had more time to 
practice the procedure and were proficient in thiuk-aloud tasks, tlie result might have been 
different. 

In addition to the aforementioned precautions while drawing conclusions, several 

limitations to the study also deserv^e attention. First of all, the thiuk-aloud procedure is 

sensitive to instructional variables. Since the procedure has not been standardized (Ward 

& Traweek 1993), different thiuk-aloud exposure (i.e., different teacher, pacing, 

e\i)lauation, modeling, etc.) might result in different effects, Secondly, text type w’as one 

vaiiablc which was not controlled by the study. Tliere is a possibility that tliink-alouds 

work better for some text types than for others. Future research on the tliiuk-aloud with 

different text t>pes is needed to determine if these results are generalizable. Tlie short 

duration of the expeiiment is an limitation, too. If the instruction is extended over a 

longer peiiod of time, students may be able to assimilate tliiiik-alouds into their repertoire 

of reading strategies more readily (Baumim, Swifeit-Kesscll, & Jones, 1992). 

Nevertheless, significant treatment effects have been reported for experiments having 

relatively short-term interv’eiition peiiods (Bereiter & Bii'd, 1985; Miller, 1985, 1987; 

/ 

Palinscar & Brown, 1984; Schmitt, 1988). Therefore, additional research is needed to 
draw' definite conclusions. Finally, populations with other linguistic and cultural 
backgrounds are needed to deteniiine if these results are generalizable beyond the scope of 
the subjects who were employed in this study. 
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Instructional implications 

Despite the limitations of the study, instructional implications can still be found 

based on the research results. EFL teachers can introduce the think-aloud procedure to 

their students and make it one of the comprehension strategies available to their students. 

.Ailcr introducing the procedure, regular practice can be used to help students to use the 

technique with greater ease. Students who are not comfortable verbalizing their tliiuking 

process can think aloud silently. To make verbalization a nauiral behavior, leaniers can 

talk to each other aloud conceraing what they do and do not understand as they read. 

These paired readers can then share problems, knowledge, and strategic resources. The 

verbahzation of expea reader can serve as a basis for designing teachable reading 

comprehension strategies, lliink-alouds should not be limited to the reading of academic 

texts, thus an EFL teacher can suggest students try using think-alouds even when they are 

reading for enjoyment. By doing so, thinL-alouds can become a comprehension-fostering 

tecluiique that pro\ides students ample opportunities for sharing, discussing, and reading 

coUaborativcIy. Finally, since not all students respond well to the procedure, the EFL 

/ 

teacher should allow students sufficient time to ex^periment with the procedure. Should 
some students find it not comfortable to use, other alternative ought to be used to help 
these students with their EFL reading. 
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Table 2 



Groun One and Group Two Students Reading Comprehension Scores of Passage A and 



Passage B 




Passage A 


Passage B 


Group 1 


M 7.68 


M 8.65 


n=31 


SD 1.56 


SD 1.02 


Group 2 


M 7.50 


M 8,92 


n=26 


SD 1.50 


SD ,98 
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Appendix 

Tliiuk-Aloud Questioimaire 

Tlie followings are questions regarding your experience witli the Tliink-Aloud procedure. 
Please feel free to give your personal opinions and answer as thorougliJy as possible. You 
can answer them either m English or Chinese , whichever serves the purpose of expressing 
your thoughts. 

1. In general, does the think-aloud procedure help or liinder your reading comprehension? 



2. In your opinion, what are the strengths of the think-aloud procedure? 



3. In your opinion, what are the weaknesses of the thinJc-aloud procedure? 



4. Have you ever used the think-aloud procedure before? 



5. Is the think-aloud procedure different from or similar to your usual reading habit? In 
what ways are they similar/different? 



6. Do you think w'e had enough time to practice the think-aloud technique before taking 
the quizzes? 



7. Do you think the think-aloud makes you more aware of your own reading behavior? 

8. Do you think the think-aloud training improves your test score? 

9. Will you continue to use the think-aloud procedure to help you read? 
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